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(54) Image-area extracting method for visual telephone 



(57) A visual telephone terminal that allows the user 
to easily designate any desired area to be extracted 
from an image being shown on a display portion (23) by 
an area-extracting frame or form prepared by using nu- 
meral keys (14a) and stored in storing means (18, 20), 
requiring no additional cost. On the numeral keys (14a) 



on the visual telephone terminal, the user selects a nu- 
meral key (14a) corresponding to a start point of area- 
extracting frame or form, moves the start point to a de- 
sired position and fixes it at the position by pressing the 
start point key, then performs similar operations for se- 
lecting and deciding the second point, thus forming the 
area-extracting form on the image. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to a visual tele- 
phone terminal and more particularly to a method for ex- 
tracting any desired area on an image being displayed 
on the visual telephone terminal having numeral keys 
on its operating portion. 

[0002] With a conventional visual telephone terminal, 
a user usually designates an image area desired to be 
extracted from an image being displayed on a display 
screen by using a drawing control portion with a mouse 
or a light-pen for easily drawing shapes on the display 
screen. 

[0003] However, the drawing control portion must be 
externally attached to a single-unit type visual telephone 
or a separate visual display unit connected to a tele- 
phone set. Therefore, it requires an additional cost. 
[0004] The conventional single-unit type or two-units 
type visual telephone terminal cannot be provided with 
an image-area extracting facility at a low expense. 

SUMMARY OF THE INVENTION 

[0005] It is the main object of the present invention to 
incorporate an image-area extracting function into a sin- 
gle-unit type visual telephone terminal or a visual tele- 
phone terminal with a display unit. 
[0006] More specifically, it is an object of the present 
invention to provide the single-unit type visual telephone 
terminal or the telephone-connected type visual tele- 
phone terminal with integral means for analogizing the 
layout of numeral keys on an operating portion of the 
terminal with a form of an image area to be extracted 
and specifying a desired area on an image being shown 
on a display screen of the terminal by using the numeral 
keys and integral means for storing the image-area ex- 
tracting frame used in a memory and using the area- 
extracting frame for promptly defining a desired area on 
another image by fixing one point of the frame as a ref- 
erence point on the image and adjusting the position of 
the diagonal point relative to the reference point to ex- 
pand or compress the frame enclosing the desired area 
by using the numeral keys. 

[0007] It is another object of the present invention to 
provide the visual telephone terminal with the above-de- 
scribed image-area extracting means which can desig- 
nate any desired area on an image shown on a display 
screen by manipulating numeral keys (push buttons) on 
the terminal (with no additional cost). 
[0008] It is another object of the present invention to 
provide the visual telephone terminal which makes it 
possible to built, for example, at a low cost a visual cat- 
alogue shopping system that enables a user to try a new 
suit shown on the display screen by exchanging a model 
face with his or her face before purchasing that suit. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 is a block diagram showing a visual tel- 
ephone terminal for realizing an image-area extracting 
s method according to the present invention. 

[001 0] Fig. 2 shows the correct alignment of the draw- 
ing sheets for Figs. 2A, 2B and 2C. 
[0011] Figs. 2A, 2B and 2C are flow chart depicting a 
procedure of extracting an image-area on a visual tele- 
10 phone terminal according to the present invention. 
[001 2] Fig. 3 shows the correct alignment of the draw- 
ing sheets for Figs. 3A and 3B. 
[001 3] Figs. 3A and 3B are flow chart depicting a pro- 
cedure of extracting an image-area on a visual tele- 
*s phone terminal according to the present invention. 
[001 4] Fig. 4 shows the correct alignment of the draw- 
ing sheets for Figs. 4A, 4B and 4C. 
[001 5] Figs. 4A, 4B and 4C are illustrative of transition 
screen images on a visual telephone when carrying out 
20 an image extraction according to the present invention. 
[001 6] Fig. 5 shows the correct alignment of the draw- 
ing sheets for Figs. 5A, 5B and 5C. 
[001 7] Figs. 5A, 5B and 5C are illustrative of transition 
screen images on a visual telephone when carrying out 
2S an image extraction according to the present invention. 
[0018] Fig. 6 is illustrative of a visual telephone with 
numerical keys which are given specific functions for 
carrying out image-area extraction according to the 
present invention. 

30 

PREFERRED EMBODIMENT OF THE INVENTION 

[001 9] Referring now to the accompanying drawings, 
preferred embodiments of the present invention will be 

35 described below in detail. 

[0020] Fig. 1 is a construction block diagram of a vis- 
ual telephone terminal embodying the present inven- 
tion. The visual telephone terminal connected to a com- 
munication channel 11 comprises a communication con- 

40 trol portion 12, an operation control portion 13, a tone 
detector 13a, an operating portion 14, numeral (ten) 
keys 14a, a codec portion 15, CPU (Central Processing 
Unit) 16, a ROM (Read Only Memory) 17, a RAM (Ran- 
dom Access Memory) 18, an external storage control 

45 portion 19, an external storage 20, a video image input 
portion 21 , a display control portion 22 and a display unit 
23. 

[0021] A signal including video information received 
over the communication channel 11 is separated into 

so video information and other information by the commu- 
nication control portion 12 and then the video informa- 
tion is stored in the FIAM 18. The operation control por- 
tion 13 receives a command signal from the operating 
portion 1 4 and performs the display operation. The ROM 

55 1 7 drives the CPU 1 6 to read the video information from 
the RAM 1 8 and decode the video information by the 
codec portion 15. The decoded video information is dis- 
played by the display control portion 22 on the display 
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screen of the display unit 23. 

[0022] The video information displayed on the display 
unit 23 can be stored in the external storage 20 through 
the external storage control portion 19 according to a 
command signal inputted through the operating portion 
14. 

[0023] In this embodiment, the operation control por- 
tion 1 3, a tone detecting portion 13a, the operating por- 
tion 14 and numeral keys 14a are provided specifically 
for carrying out the image-area extraction according to 
the present invention. 

[0024] Figs. 2A, 2B and 2C are flow chart depicting 
the procedure of extracting an area from an image dis- 
played on a visual telephone terminal according to an 
aspect of the present invention. 
[0025] Referring to Figs. 2A, 2B and 2C, the operation 
of the embodiment will be described below. 
[0026] The terminal is switched on (Step S20) and be- 
comes in waiting state (Step S21). Video information is 
input or received (Step S22) and stored in the RAM 18. 
When it is desired to extract an area of the image being 
displayed on a display screen, a menu key is pressed 
(Step S24). The menu is displayed on the display screen 
(Step S25). 

[0027] A mode of extracting an image area by using 
an area-extracting quadrangle, which can be specified 
by two sides, is selected from the menu (Step S26). The 
image information is read from the RAM 18 and dis- 
played on the display portion 23 (Step S27). A pointer 
for drawing the area-extracting frame is also shown on 
the image being displayed (Step S28). 
[0028] The pointer is moved along one side of a de- 
sired image area on the display screen by manipulating 
numeral keys to which cursor-functions are assigned 
among the numeral keys 1 3a disposed on the operating 
portion 13 (Step S29). 

[0029] The image-area extracting method of the 
present invention is featured by using numeral keys to 
which functions necessary for specifying an area of an 
image being shown on the display screen are assigned. 
For example, an area-extracting frame is a quadrangle 
whose four corner points are represented by four nu- 
meral keys: a top-left point by a key "1 B , a top-right point 
by a key "3", a bottom-left point by a key '7' and a bot- 
tom-right point by a key "9" (see Fig. 6). 
[0030] The cursor functions are assigned to other nu- 
meral keys, i.e. keys "2", "4', '6" and "8" are used for 
moving a pointer upward, leftward, rightward and down- 
ward respectively. 

[0031] Of course, the assignment of functions to the 
numeral keys may be modified depending upon the im- 
age-area extracting form. In this embodiment, a quad- 
rangular frame or form is used for convenience of ex- 
planation. 

[0032] After the pointer is positioned at a start point 
and the start point is selected by pressing a key corre- 
sponding to a start point of the first side (Step S210), 
procedure advances to Step S211 and a line from the 



start point is drawn on the image by continuously press- 
ing the cursor function key (Step 212). However, the 
CPU does not advance the procedure to the next step 
until the user operates the corresponding keys at Step 

s S210andS211. 

[0033] A key corresponding to an end of the first side 
is selected (Step S21 3). The image together with infor- 
mation on the pointer positions at Step S213 is stored 
in the RAM 1 8. As first side of the area has been drawn 

10 at Step S213, pressing the cursor function key (Step 
S215) results in drawing a second side from the first- 
side end position (Step S21 6) in the direction of the cur- 
sor movement. 

[0034] The end of the second side is selected (Step 
is S217). A quadrangular area defined by the two drawn 
sides is indicated on the image shown on the display 
portion 23 (Step S218). The extractable area is con- 
firmed (Step S219). It is then decided whether the con- 
firmed form (area-extracting frame) is registered in the 
20 RAM 18 or not. 

[0035] The area-extracting frame is stored in the RAM 
1 8 (Step S221 ) and the area-extracting procedure ends. 
If the registration of the frame or form is not desired (at 
Step S220), the procedure advances to Step S222 and 
25 ends. 

[0036] When the area-extraction was not confirmed 
at Step S21 9, the procedure proceeds to Step S223 for 
deciding whether the extracting form is corrected or not. 
If correction is needed, the CPU erases all the image 

30 being displayed at Step S224 and then returns the pro- 
cedure to Step S27 to start the input operation. 
[0037] Figs 3A and 3B are flow chart depicting the im- 
age-area extracting procedure with a visual telephone 
according to the present invention. Referring to Figs. 3A 

35 and 3B, the operation of the visual telephone according 
to the method of the present invention will be described 
below: 

[0038] The power switch is turned ON (Step S30) and 
the visual telephone enters into a state waiting for an 

40 input (Step S31 ). Video information is input or received 
(Step S32) and stored in the RAM 18. 
[0039] In extracting an image area from the input or 
received image, the user selects a menu by pressing 
the menu key (Step S34). The menu is displayed on the 

45 display screen (Step S35). 

[0040] When the user selects the use of previously 
prepared arid registered frame (Step S36) and desig- 
nates one of the area extracting frames or forms (Step 
S37), the image information is read from the RAM 18 

so (Step S38) and displayed on the display portion 23 and, 
at the same time, the area-extracting frame or form se- 
lected at Step S37 is also shown thereon on the display 
portion 23. 

[0041] In order to position the area-extracting frame 
55 or form at a desired position on the image, the user first 
selects the reference (start) point by pressing a corre- 
sponding key among the numeral keys 1 4a (Step S391 , 
then moves the reference point by manipulating cursor- 
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function keys (among the numeral keys 14a) to a de- 
sired position (Step S310) and finally decides the posi- 
tion by pressing again the key first pressed for selecting 
the reference point (Step S31 1 ). 
[0042] On completion of positioning the reference 
point, the pointer is automatically shifted to a position 
diagonally opposite to the reference point (Step S312). 
The user moves the pointer on the image by using a 
cursor-function key. The area-extracting frame or form 
appears on the image and is enlarged or compressed 
with the movement of the pointer. Thus the area-extract- 
ing frame or form can be adjusted to any desired size 
on the image shown on the display portion (Step S31 3). 
[0043] The point being moved by the cursor is fixed 
at any position when the key corresponding to the comer 
point of the quadrangular frame or form on the numeral 
keys 1 4a is pressed by the user (Step S31 4). The area- 
extracting procedure is finished (Step S315). 
[0044] Figs. 4A, 4B and 4C depict a transition of an 
image displayed on the display portion while extracting 
an image area by using a quadrangular area-extracting 
frame or form according to the method as defined in 
claim 1 . In Figs. 4A, 4B and 4C, messages for explaining 
the respective steps are shown on respective images 
being displayed, which, however, may be omitted or 
shown without the images. The display image transition 
steps will be described below referring also to the area- 
extracting procedure steps of Figs. 2A, 2B and 2C. 
[0045] An image (Step S40) is illustrative of the area- 
extracting procedure step S28 of Fig. 2A. An image and 
a pointer are displayed on the display portion. A next 
image (Step S41) depicts the subsequent operating 
steps to be performed by the user, which image may be 
omitted. 

[0046] The display image changes to an image (Step 
S42) which reflects operations made by the user on the 
operating portion 14 (with numeral keys 14a) to move 
the pointer by using the numeral keys "2 B and "4", fix the 
position at a top left position as a start point by pressing 
the numeral key "1 ■ and plot a line rightward from the 
start point by continuously pressing the numeral key "6" 
for moving the pointer rightward. Namely, this image 
concerns the image-area extracting procedure steps 
S210 to S212 (Figs. 2A and 2B). 
[0047] The numeral key "3" corresponding to an end 
of a first side of the quadrangular area-extracting form 
is pressed. The display image changes to a subsequent 
image (Step S42) showing a message for explaining a 
procedure of plotting a second side of the quadrangular 
frame or form. However, this message may be omitted 
if it is so desired. 

[0048] The numeral key B 8 B on the operating portion 
14 with the numeral-keys 14a is continuously pressed 
by the user. The display image changes to a subsequent 
image (Step S44) in which the second side of the quad- 
rangle is being drawn. The numeral key B 9 B correspond- 
ing to an end of the second side of the area-extracting 
quadrangle is pressed. The display image changes to a 



subsequent image (Step S45) showing that the second 
side of the quadrangle is decided and the quadrangle 
for extracting a desired image area is prepared based 
on the two plotted sides. (This image concerns the step 

s S218of Fig.2C.) 

[0049] Figs. 5 A, 5B and 5C depicts a transition of an 
image displayed on the display portion while extracting 
an image area by using one of the registered quadran- 
gular area-extracting frame or forms according to the 

10 method of the present invention In Figs. 5 A, 5B and 5C, 
messages for explaining the respective steps are shown 
on respective images to be displayed, which massage, 
however, may be shown otherwise or omitted. 
[0050] The display image transition steps will be de- 

7£ scribed below referring also to the area-extracting pro- 
cedure steps of Figs. 3A and 3B. 
[0051] A display image (Step S50) is illustrative of the 
area-extracting procedure step S38 of Fig. 3A. After the 
step S52, an image (Step S51) is shown for explaining 

20 the subsequent operating steps, which image may be 
omitted if so programmed. 

[0052] In the case when the user desired to set a ref- 
erence point at a top left position, he or she presses the 
numeral key "1 " corresponding to a top-left point of a 

25 quadrangular area-extracting frame or form on the op- 
erating portion 1 4 with the numeral-keys 1 4a and moves 
the pointer to a desired top-left position on the image 
being displayed by using numeral keys B 2 B and B 4" to 
which cursor functions are assigned. 

30 [0053] The user presses again the numeral key "1 " to 
fix the reference point at the selected position. The dis- 
play image changes to an image (Step S52) that reflects 
the procedure from Step S39 to Step S311 of Figs. 3A 
and 3B. 

35 [0054] As soon as the reference point is fixed, the 
pointer is automatically transferred to a diagonal point 
of the area-extracting quadrangle and a massage for 
subsequent procedure step appears on the image if 
such a message has been programmed (Step S53). In 

40 the shown case, the pointer is transferred from the top 
left to the bottom right when the key B 1 " was pressed for 
fixing the reference point. 

[0055] The pointer at the bottom right position is fur- 
ther moved by using the numeral keys "2" and "4 B to a 

45 suitable position to adjust the size of the area-extracting 
quadrangle. The display shows an image of Step S54. 
The user can adjust the size of the quadrangle observ- 
ing the change of the form with the pointer's movement 
on the display image. The desired size of the quadrangle 

50 can be fixed by pressing the numeral key B 9 B corre- 
sponding to the bottom right position. 
[0056] At this time, the display shows an image of 
Step S55 (Fig. 5C), which corresponds to the procedure 
step S314of Fig. 3B. 

55 [0057] Fig. 6 shows an exemplary visual-telephone 
terminal according to the present invention. An enlarged 
detail of the numeral keys depicts an exemplified as- 
signment of functions for carrying out the image-area 
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extracting method of the present invention. 
[0058] As is apparent from the foregoing, the present 
invention offers the following advantages: 
[0059] The visual telephone terminal provided with 
the above-described image-area extracting means can & 
designate any desired area on an image shown on a 
display screen by manipulating numeral keys (push but- 
tons) on the terminal (with no additional cost). This 
makes it possible to built, for example, at a low cost a 
visual catalogue shopping system that enables a user 
to try a new suit shown on the display screen by ex- 
changing a model face with his or her face before pur- 
chasing that suit. 

Claims 

1. An image-area extracting method for visual tele- 
phone terminal provided with a video displaying 
means (23) for receiving a video signal transmitted 
over a communication channel (1 1 ) through a com- 
munication control portion (12), converting the re- 
ceived signal by a converting portion (15) and dis- 
playing a received video image by a display control 
portion (22), and an image storing means (18, 20) 
for storing the received video image, characterized 
in that an objective area (e.g., a face area) can be 
extracted from an image being displayed by an ar- 
ea-extracting frame line formed by using analogy of 
a layout of numeral keys (14a) arranged on the vis- 
ual telephone terminal. 

2. An image-area extracting method for visual tele- 
phone terminal as defined in claim 1 , characterized 
in that the image-area extracting frame used is 
stored in the image storing portion (18, 20) to be 
used later for promptly specifying a desired objec- 
tive area on the image by fixing one point of the im- 
age-area extracting frame as a reference point at a 
desired position on the image and then adjusting 
the position of a diagonal point relative to the refer- 
ence point to expand or compress the frame enclos- 
ing the desired objective area by using the numeral 
keys (14a) arranged on the visual telephone termi- 
nal. 

3. Image display apparatus comprising an image dis- 
play screen, display control means for displaying an 
image on said display screen in accordance with a 
video signal, keyboard means including a set of nu- 
merical keys, and means operable in an image por- 
tion designating mode to permit user operation of 
said set of numerical keys to designate a desired 
area on said display screen delimited by a displayed 
area-defining frame. 

4. A display apparatus for a visual telephone terminal 
in which a desired portion of a displayed image can 



be designated by manipulation of numerical keys to 
control the formation and/or alteration of a dis- 
played area-defining frame. 

5. A display method for a visual telephone terminal in 
which a desired portion of a displayed image can 
be designated by manipulation of numerical keys to 
control the formation and/or alteration of a dis- 
played area-defining frame. 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



5 



EP0 895 418 A2 



CO 



CVJ 





00 


\ 


rA— , 








o 




< 











n 



< LU 
QZ 
ZZ 
3< 

1° 

o 
o 



EP 0 895 418 A2 



STEP 20 



STEP 21 



STEP 22 



STEP 23 



FIG.2A 

TURNING ON A POWER SUPPLY SWITCH | 



STEP 24 



STEP 25 



WAITING 



I 



RECEIVING VIDEO INFORMATION 



I 



STORING THE VIDEO INFORMATION 

IN THE RAM 18 

1 



PRESSIN G A MENU KEY 



THE MENU IS DISPLAYED 



FIG.2 




STEP 26 



NO 



IS A MODE 
OF PREPARING AN 
AREA-EXTRACTING FORM (FRAME) 
BY DRAWING TWO SIDES THERE 
OF BY OPERATING PORTION 14 

SELECTED 



YES 



STEP 27 



READING THE VIDEO INFORMATION FROM 
THE RAM 18 AND DISPLAYING ON 
A DISPLAY PORTION 23 



STEP 28 



I 



DISPLAYING A POINTER ON THE 
DISPLAY PORTION 23 



STEP 29 



I 



MOVING THE POINTER BY USING CURSOR 

FUNCTION KEYS 



STEP 210 _ 

IS A START 
POINT OF THE FIRST SIDE' 
OF AN AREA-EXTRACTION 
FORM SELECTED 



YES 



7 



EP0 895 418 A2 



FIG.2B 
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FIG.2C 
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